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FOREWORD 


The  Army  Research  Institute  and  the  American  Institutes  for  Research  have 
devt  loped  the  Officer  Sele<  tion  Battery  (OSB)  for  use  ir.  selecting  young  men 
and  women  for  Advanced  Army  ROTC  3nd  for  Army  Officer  Candidate  School.  The 
test  was  developed  in  response  to  the  Army's  determination  to  select  officer 
candidates  on  dimensions  considered  to  be  important  for  successful  officer  job 
performance. 

The  present  Technical  Report  is  provided  in  response  to  a  request  from 
the  Deputy  Chief  of  Staff  for  ROTC  to  determine  the  correlations  between  the 
OSB  and  che  five  individual  areas  of  evaluation  comprising  the  ROTC  Basic  Camp 
Student  Evaluation  Report.  Based  upon  the  results  of  this  research,  it  5s 
recommended  that  consideration  be  gi«en  to  increasing  the  weight  given  the  OSB 
component  in  the  Student  Potential  Index. 


Technical  Director 
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CORRELATION  BETWEEN  THE  OFFICER  SELECTION  BATTERY  AND 
THE  ROTC  BASIC  CAMP  STUDENT  EVALUATION  REPORT 


EXECUTIVE  SUMMARY 


Requirement : 

To  determine  (I)  the  correlation  between  the  Officer  Selection  Battery 
(OSB)  and  the  five  individual  areas  of  evaluation  comprising  the  ROTC  Basic 
Camp  Student  Evaluation  Report  and  (2)  the  extent  to  which  performance  on  the 
OSB  is  moderated  by  the  educational  level  of  the  ROTC  recruit. 


Procedure : 

Data  from  3,668  ROTC  candidates  who  were  tested  on  the  OSB  during  ROTC 
Basic  Camp  in  1983  and  for  whom  scores  were  available  on  tne  ROTC  Basic  Camp 
Student  Evaluation  Report  were  analyzed.  Correlations  were  computed  between 
the  OSB  and  the  five  individual  areas  comprising  the  ROTC  Basic  Camp  Student 
Evaluation  Report  in  addition  to  the  educational  level  of  the  ROTC  candidates. 


Findings: 

The  correlation  between  Che  OSB  and  the  academic  measure  (SCAT)  on  the 
Student  Evaluation  Report  was  .79.  However,  for  the  remaining  four  measures 
on  the  Student  Evaluation  Rr  ,  the  correlations  ranged  from  .07  to  .25. 


Utilization  of  Findings: 

The  Student  Potential  Index  (SP1),  which  is  a  composite  score  based  upon 
separate  weightings  of  the  five  individual  areas  on  the  Student  Evaluation 
Report,  presently  assigns  a  102  weighting  factor  to  the  academic  measure. 
Because  of  the  importance  of  academic  ability  in  successful  completion  of  the 
ROTC  program,  consideration  should  be  given  to  increasing  the  weight  given  the 
OSB  component  of  the  Student  Potential  Index. 
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CORRELATION  BETWEEN  THE  OFFICER  SELECTION  BATTERY 
AND  THE  ROTC  BASIC  AMP  STUDENT  EVALUATION  REPORT 


INTRODUCTION 

The  purpose  of  this  research  is  to  examine  the  correlation  between  the 
Officer  Selection  Battery  (OSB)  and  the  five  individual  areas  of  evaluation 
comprising  the  ROTC  Basic  Camp  Student  Evaluation  Report,  and  to  assess  the 
extent  to  which  performance  on  the  OSB  is  moderated  by  the  educational  level 
of  the  ROTC  recruit.  The  Officer  Selection  Battery  (OSB)  is  a  recently  devel¬ 
oped  paper-and-pencil  test  (Fischl,  Edwards,  Claudy,  and  Rumsey,  1986)  for 
selecting  men  and  women  for  Advanced  Army  ROTC  and  for  Army  Officer  Candidate 
School.  Content  specification  for  the  test  items  in  the  OSB  involved  identi¬ 
fication  of  the  dimensions  considered  to  be  important  for  successful  officer 
job  performance.  Correspondingly,  the  ROTC  Basic  Camp  Student  Evaluation  Sys¬ 
tem  is  designed  to  assess  the  student's  military  knowledge,  skills,  and  offi¬ 
cer  potential  within  an  operational  officer  training  environment. 


METHOD 

The  sample  consisted  of  3,668  ROTC  candidates  who  were  tested  on  the  OSB 
during  ROTC  Basic  Camp  in  1983  and  for  whom  scores  on  the  ROTC  Basic  Camp  Stu¬ 
dent  Evaluation  Report  were  available.  The  Student  Evaluation  Report  provides 
a  summary  in  Army  Standard  ^ore  units  of  five  individual  areas  of  evaluation 
in  addition  to  a  sixth  measure,  the  Student  Potential  Index  (SPI),  which  is  a 
composite  score  based  upon  .separate  weightings  of  the  five  individual  areas. 
Table  1  presents  the  five  areas  of  evaluation  and  the  weighting  of  each  area 
for  the  Student  Potential  Index. 


Table  1 

Correlation  of  th.  Five  Evaluation  Areas  and  the  Weights  for 
Computing  the  Student  Potential  Index 


Evaluation  Area 

Weighting 

1.  Physical  Fitness  Test  (PFT) 

20% 

2.  Graded  Military  Skills  Test  (GMST) 

30% 

3.  Job  Performance  Rating  (JPR) 

20% 

4.  Peer  Rating  (PR,  Total) 

10% 

a.  Future  Manager/Supervisor/Command ir 

(5%) 

b.  Student  Team  Member 

(5%) 

5.  Academic  (ACAD,  average  of  a  and  b  below) 

20% 

a.  Student  Grade  Point  Average 

(10%) 

b.  Scholastic  Potential  (SCAT,  CEB) 

(10%) 

6.  Student  Potential  Index  (SPI,  Total  of  Weighted 
Areas  1-5) 

Army  Standard  Scores  for 
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The  Physical  Fitness  Test  (PFT)  comprises  the  following  events:  run, 
dodge,  jump;  pushups;  bent  leg  situps;  inverted  crawl;  a  two-mile  run  and  an 
80-meter  shuttle  run  for  men  and  a  one-mile  run  for  women.  The  Graded  Mili¬ 
tary  Skills  Test  (GMST)  is  designed  to  measure  the  student’s  ability  to  apply 
military  skills  in  the  following  areas:  individual  and  team  tactics,  first 
aid,  communication,  basic  rifle  marksmanship,  and  land  navigation.  The  Job 
Performance  Rating  (JPR)  is  completed  by  the  platoon  advisor  on  each  student 
and  is  designed  to  provide  an  assessment  of  the  student's  ability  to  handle 
people  and  situations  and  to  assist  the  student  in  developing  potential  for 
becoming  an  Army  officer.  For  the  Peer  Rating  (PR)  measure,  each  student  is 
rated  by  all  other  students  as  future  managers/supervisors/commanders  and  in 
regard  to  their  contributions  as  team  members  in  accomplishing  mission  objec¬ 
tives.  The  Academic  (ACAD)  measure  comprises  the  student's  grade  point  average 
(ACADa)  and  scholastic  potential  (ACAD^)  as  measured  by  either  the  Cooperative 
School  and  College  Ability  Tests  (SCAT)  or  the  Cadet  Evaluation  Battery  (CEB). 
Finally,  a  composite  score,  the  Student  Potential  Index  (SPI),  is  based  upon 
a  total  of  the  five  weighted  Army  Standard  Scores  as  shown  in  Table  1. 

A  variable  (EDUC)  related  to  education  level  was  constructed  by  assigning 
1  to  high  school  level  recruits;  2  to  college  freshmen;  3  to  college  sopho¬ 
mores;  and  4  to  college  juniors,  seniors,  and  graduate  students;  all  other 
variables  used  in  the  analyses  were  expressed  in  Army  Standard  Scores.  In 
addition,  to  the  standard  SPI  (SPI-S),  three  other  SPI  indices  were  computed 
and  analyzed  separately.  Because  the  OSB  was  designed  to  replace  the  SCAT  or 
CEB,  a  second  Student  Potential  Index  (SPI-2)  was  computed  in  which  OSB  re¬ 
placed  SCAT  or  CEB  (3b  in  Table  1).  A  third  Student  Potential  Index  (SPI-3) 
was  computed  in  which  the  weighting  for  GMST  (Area  2  in  Table  1)  was  weighted 
20%  and  OSB  was  increased  to  20%.  Finally,  a  fourth  Student  Potential  Index 
(SPI-4)  was  computed  in  which  evaluation  areas  I,  2,  and  3  in  Table  1  were  each 
assigned  15%  and  OSB  was  increased  to  35%.  These  weights  were  chosen  in  order 
to  increase  the  weighting  of  OSB  in  relation  to  the  Graded  Military  Skills  Tests 
in  the  computation  of  the  Student  Potential  Index. 


RESULTS  AND  DISCUSSION 

Table  2  presents  the  intercorrelation  matrix  among  the  six  measures  on 
the  ROTC  Basic  Camp  Student  Evaluation  Report  in  addition  to  the  Officer  Selec¬ 
tion  Battery  (OSB)  and  Education  Level  (EDUC).  Because  the  Student  Potential 
Index  (SPI)  comprises  five  separate  evaluation  areas,  the  rather  large  correla¬ 
tions  between  each  of  the  five  separate  areas  and  SPI  were  expected.  Of  major 
interest  in  Table  2  io  the  correlation  between  OSB  and  tue  separate  measures 
on  the  Student  Evaluation  Report.  Vhe  correlation  of  .79  between  the  OSB  and 
the  ACADjj  (SCAT)  provides  evidence  for  the  validity  of  OSB  as  a  measure  of 
scholastic  aptitude.  Since  the  OSB  was  designed  to  replace  ACAD^  in  the  Cadet 
Evaluation  Battery  and  has  beer  shown  to  have  correlations  ranging  from  .78-. 85 
with  the  SAT  (Fischl,  Edwards,  Claudy,  anJ  Rumsev,  1986),  the  rather  substantial 
correlation  with  the  academic  measure  was  expected. 
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Table  2 


Intercorrelatlon  Matrix  Among  the  Five  Areas  on  the  ROTC  Basic  Camp  Student 
Evaluation  Report,  SPI,  OSB,  and  EDUC 


PFT 

GMST 

JPR 

PRa 

PRb 

ACADa 

ACADb  SPI 

OSB 

EDUC 

(CPA) 

(SCAT) 

PFT  ] 

l  .00 

GMST 

.44 

1.00 

JPR 

.42 

.35 

1.00 

PRa 

.45 

.42 

.67 

1.00 

PRb 

.44 

.42 

.61 

.88 

1.00 

ACADa 

(GPA) 

.09 

.10 

.08 

.07 

.11 

1.00 

ACADb 
( SCAT) 

.13 

.30 

.19 

.18 

.21 

.30 

1.00 

SPI 

.73 

.80 

.74 

.70 

.69 

.29 

.44 

1.00 

OSB 

.07 

.25 

.13 

.14 

.17 

.30 

.79 

.34 

1.00 

EDUC 

.03 

.00 

.05 

.06 

.09 

.00 

.00 

.03 

.08 

1.00 

The  education  level  (EDUC)  variable  has  no  significant  relationship  with 
any  variable  in  Table  2.  Although  the  rank  ordering  of  the  education  variable 
is  arbitrary  and  perhaps  somewhat  gross,  the  differences  in  the  means  on  the 
OSB  for  the  four  groups  were  in  the  expected  direction.  The  mean  raw  scores  or. 
the  OSB  for  high  school  seniors  (N=444);  freshmen  ( N=4 12);  sophomores  (N=2,159), 
juniors,  seniors,  end  graduate  students  (N=65l)  were:  73.99,  74.26,  74.92,  and 
76.07,  respectively.  On  average,  more  academically  experienced  students  scored 
higher  on  OS3. 

In  order  to  determine  whether  level  of  Education  had  a  moderating  effect 
on  OSB  scores  in  the  prediction  of  the  Student  Potential  Index  (SPI),  a  general 
linear  model  analysis  was  used  in  which  OSB,  Education  level,  and  the  interaction 
of  OSB  by  Education  level  were  entered  as  the  predictor  set.  The  resulting 
was  .12  with  OSB  as  the  major  contributing  variable  (F  =  485.23;  df  =  1/3,653; 
p<.0001).  The  overall  interaction  effect  of  OSB  X  Education  level  was  not  sig¬ 
nificant.  However,  separate  analyses  of  each  Education  level  X  OSB  revealed 
a  significant  effect  (£  =  7.15;  df  =  1/3,658;  p<.008)  for  the  0S3  and  the  Edu¬ 
cation  level  1/non-Education  level  1  categorical  variable.  Ii  a  second  general 
linear  model  analysis  in  which  the  interaction  effects  of  OSB  and  the  Education 
level  categorical  variables  were  omitted  from  the  predictor  set,  there  was  only 
a  .002  decrease  in  R^.  Thus,  the  relationship  between  OSB  and  SPI  is  moderated 
only  very  slightly  by  Education  level. 

Obviously,  the  correlation  between  OSB  and  SPI  is  directly  related  to  the 
weighting  OSB  assumes  in  the  computation  of  SPI.  When  the  weightings  of  PFT, 
GMST,  and  JPR  are  reduced  as  in  SPI-4,  there  is  an  increase  in  the  correlation 
between  OSB  and  SPI  (r**.61).  The  basis  for  the  alternate  weighting  schemes  was 
a  factor  analysis  of  the  evaluation  areas  comprising  the  SPI.  Results  of  the 
factor  analyses  are  presented  in  Appendix  A.  Briefly,  the  results  from  the 
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principal  components  factor  analysis  yielded  two  major  factors.  Factor  1  ac¬ 
counted  for  46 %  of  the  variance  and  Factor  2  17%  of  the  variance.  Inspection 
of  Appendix  A  reveals  the  PFT,  GMST,  JPR,  PRg  and  PRj,  all  loading  on  the  same 
factor.  These  results  provided  the  impetus  for  the  alternate  weighting  schemes 
proposed  in  Table  3. 


Table  3 

Four  Different  Weighting  Schemes  of  the  Five  Evaluation  Areas  on  the 
Student  Evaluation  Report 


Weighting  Factors 

Evaluation  Area 

SPI-  S 

SPI-2  SPI-3 

SPI-': 

1.  PFT 

.20 

.20 

.20 

.15 

2.  GMST 

.30 

.30 

.20 

.15 

3.  JPR 

.20 

..20 

.20 

.15 

4.  PR 

a.  Future  Manager 

.05 

.05 

.05 

.05 

b.  Student  Team  Leader 

.05 

.05 

.05 

.05 

5.  ACAD 

a  -  GPA 

.10 

.10 

.10 

.10 

b.  SCAT 

.10 

c.  OSB 

.10 

.20 

.35 

6.  SF1  r  OSB 

.34 

.43 

.61 

Finally,  the  relationship  between  four  OSB  categories  and  the  frequency 
with  which  Race  and  Sex  categories  scored  in  these  categories  was  determined. 
The  four  OSB  categories  were  based  upon  Army  Standard  Scorer,  on  the  OSB  and 
were:  Cat  1  *=  97  or  greater;  CAT  2  =*  94-96;  CAT  3  =  92-93;  CAT  4  *=  91  and 
below.  These  results  are  presented  in  Appendix  B.  Since  there  are  different 
conversion  tables  for  high  school  seniors  (EDUC  1),  this  group  was  omitted  in 
the  analyses  presented  in  Appendix  B. 


CONCLUSIONS  AND  RECOMMENDATIONS 

The  Officer  Selection  Battery  provides  a  satisfactory  measure  of  academic 
ability.  With  the  exception  of  the  academic  (ACADg)  measure  in  the  present 
SPI,  there  is  relatively  little  relationship  between  performance  on  the  OSB  and 
the  remaining  measures  comprising  the  Student  Potential  Index.  Based  upon  the 
results  of  this  investigation,  the  following  recommendations  appear  to  be 
warranted: 

1.  The  OSB  is  a  satisfactory  measure  of  academic  ability  and  may  replace 
other  academic  measures  in  Che  Student  Potential  Index. 

2.  Because  of  the  importance  of  academic  ability  in  successful  completion 
of  the  ROTC  program,  consideration  should  be  given  to  increasing  the 
weight  given  the  QSB  component  of  the  Student  Potential  Index. 
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APPENDIX  A 

PRINCIPAL  COMPONENTS  FACTOR  ANALYSIS  OF  THE  STUDENT  EVALUATION  REPORT 


Factor  Loadings 


Evaluation  Area 

Factor  1 

Factor 

PFT 

.66 

-.08 

GMST 

.66 

.13 

JPR 

.79 

-.16 

PRa 

.88 

-.22 

PRb 

.87 

-.17 

ACADa  (GPA) 

.21 

.77 

ACADb  (SCAT) 

.38 

.71 
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OSB  Category 


Army  Standard  Score 


OSBCAT  1 
OS BOAT  2 
OSBCAT  3 
OSBCAT  4 


9?  or  greater 
94  -  96 
92  -  93 
91  or  below 


OSBCAT 

FREQ 

CUMULATIVE  PERCENT 

OSBCAT 

FREO 

CUMULATIVE  PERCENT 

White  - 

Females 

White  - 

Males 

1 

322 

67 

i 

1358 

71 

2 

38 

75 

2 

151 

79 

3 

19 

79 

3 

65 

83 

4 

99 

100 

4 

330 

100 

Asian  - 

Females 

Asian  - 

Males 

1 

1 

14 

1 

17 

40 

2 

1 

29 

2 

3 

47 

3 

3 

71 

3 

3 

53 

4 

2 

100 

4 

20 

100 

Black.  - 

Females 

Black  - 

Males 

1 

27 

14 

1 

110 

21 

2 

20 

19 

2 

43 

29 

3 

9 

24 

3 

23 

34 

4 

145 

100 

4 

344 

100 

American  Indian  - 

Females 

American  Indian 

-  Males 

1 

0 

0 

1 

3 

50 

2 

1 

33 

2 

0 

50 

3 

1 

67 

3 

1 

67 

4 

1 

100 

4 

2 

100 

Other  - 

Females 

Other  - 

Males 

1 

1 

13 

1 

24 

49 

2 

3 

50 

2 

2 

53 

3 

2 

75 

3 

3 

59 

4 

2 

100 

4 

20 

100 

Unknown 

-  Females 

Unknown 

-  Males 

1 

1 

33 

1 

7 

58 

2 

0 

33 

2 

0 

58 

3 

0 

33 

3 

0 

58 

4 

2 

100 

4 

5 

100 

* 
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